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DETAILED ACTION 



Response to Arguments 

1 . Applicant's arguments, see Remarl<s page 8, filed 08/14/2008, with respect to the 
rejection(s) of claim(s) 1-4 and 6-7 under 35 USC 102(b) have been fully considered 
and are persuasive. Therefore, the rejection has been withdrawn. However, upon 
further consideration, a new ground(s) of rejection is made in view of Griniasty US 
20030088416 A1 (hereinafter Griniasty). Though, Luk teaches probabilistic 
transcription of phonemes and graphemes relevant to several probabilities, Examiner 
concurs that Luk fails to teach successive probabilities in a matrix form, wherein multiple 
transcriptions based on concatenations take place, where the best probability is chosen 
from multiple probabilities. 



Re Double Patenting, Applicant is reminded of the following: 

There are at least two reasons for insisting upon a terminal disclaimer to overcome a 
**>nonstatutory< double patenting rejection in a continuing application subject to a 20- 
year term under 35 U.S.C. 154(a) (2). First, 35 U.S.C. 154(b) includes provisions for patent 
term extension based upon prosecution delays during the application process. Thus, 35 
U.S.C. 154 does not ensure that any patent issuing on a continuing utility or plant 
application filed on or after June 8, 1995 will necessarily expire 20 years from the 
earliest filing date for which a benefit is claimed under 35 U.S.C. 120 . 121, or 365(c) . 
Second, 37 CFR 1.321(c) (3) requires that a terminal disclaimer filed to obviate a 
**>nonstatutory< double patenting rejection >based on commonly owned conflicting 
claims< include a provision that any patent granted on that application be enforceable 
only for and during the period that the patent is commonly owned with the application or 
patent which formed the basis for the rejection. **>37 CFR 1.321 (d) sets forth the 
requirements for a terminal disclaimer where the claimed invention resulted from 
activities undertaken within the scope of a joint research agreement. These 
requirements serve< to avoid the potential for harassment of an accused infringer by 
multiple parties with patents covering the same patentable invention**. See, e.g.. In re 
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Van Ornum, 686 F.2d 937, 944-48, 214 USPQ 761 , 767-70 (CCPA 1982). Not insisting 
upon a terminal disclaimer to overcome a **>nonstatutory< double patenting rejection in 
an application subject to a 20-year term under 35 U.S.C. 154(a) (2) would result in the 
potential for the problem that 37 CFR 1.321(c) (3) was promulgated to avoid. 

Accordingly, a terminal disclaimer under 37 CFR 1.321 is required in an application to 
overcome a **>nonstatutory< double patenting rejection, even if the application was 
filed on or after June 8, 1 995 and claims the benefit under 35 U.S.C. 120 , 121 , or 365(0) 
of the filing date of the patent or application which forms the basis for the rejection. 
Examiners should respond to arguments that a terminal disclaimer under 37 CFR 1.321 
should not be required in a continuing application filed on or after June 8, 1995 to 
overcome a **>nonstatutory< double patenting rejection due to the change to 35 U.S.C. 
154 by citing to this section of the MPEP or to the Official Gazette notice at 1202 O.G. 
112 (Sept. 30, 1997). 



AND 



If multiple conflicting patents and/or pending applications are applied in double 
patenting rejections made in a single application, then prior to issuance of that 
application, it is necessary to disclaim >the terminal part of any patent granted on the 
application which would extend beyond the application date of< each one of the 
conflicting** >patents and/or applications<. A terminal disclaimer fee is required for each 
terminal disclaimer filed. To avoid paying multiple terminal disclaimer fees, a single 
terminal disclaimer >based on common ownership< may be filed, **>for example, in 
which the term disclaimed is based on all the conflicting, commonly owned double 
patenting references**. Similarly, a single terminal disclaimer based on a joint research 
agreement may be filed, in which the term disclaimed is based on all the conflicting 
double patenting references. < 

**>Each< one of the >commonly owned< conflicting double patenting references 
**>must be included in the terminal disclaimer< to avoid the problem of dual ownership 
of patents to patentably indistinct inventions in the event that the patent issuing from the 
application being examined ceases to be commonly owned with any one of the double 
patenting references that have issued or may issue as a patent. Note that 37 CFR 
1.321(c)(3) requires that a terminal disclaimer >for commonly owned conflicting claims< 
"[ijnclude a provision that any patent granted on that application or any patent subject to 
the reexamination proceeding shall be enforceable only for and during such period that 
said patent is commonly owned with the application or patent which formed the basis for 
the rejection." 

>Filing a terminal disclaimer including each one of the conflicting double patenting 
references is also necessary to avoid the problem of ownership of patents to patentably 
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indistinct inventions by parties to a joint research agreement. 37 CFR 1.321 (d) sets fortli 
the requirements for a terminal disclaimer where the claimed invention resulted from 
activities undertaken within the scope of a joint research agreement.< 

Double Patenting 

2. The nonstatutory double patenting rejection is based on a judicially created 
doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the 
unjustified or improper timewise extension of the "right to exclude" granted by a patent 
and to prevent possible harassment by multiple assignees. A nonstatutory 
obviousness-type double patenting rejection is appropriate where the conflicting claims 
are not identical, but at least one examined application claim is not patentably distinct 
from the reference claim(s) because the examined application claim is either anticipated 
by, or would have been obvious over, the reference claim(s). See, e.g.. In re Berg, 140 
F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re Goodman, 11 F.3d 1046, 29 
USPQ2d 2010 (Fed. Cir. 1993); In re Long!, 759 F.2d 887, 225 USPQ 645 (Fed. Cir. 
1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re Vogel, 422 
F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 USPQ 
644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1 .321 (c) or 1 .321 (d) 
may be used to overcome an actual or provisional rejection based on a nonstatutory 
double patenting ground provided the conflicting application or patent either is shown to 
be commonly owned with this application, or claims an invention made as a result of 
activities undertaken within the scope of a joint research agreement. 
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Effective January 1 , 1994, a registered attorney or agent of record may sign a 
terminal disclaimer. A terminal disclaimer signed by the assignee must fully comply with 
37 CFR 3.73(b). 

3. Claims 1 and 7 are provisionally rejected on the ground of nonstatutory 
obviousness-type double patenting as being unpatentable over claims 1 , 5-7, and 11-12 
of copending Application No. 1 1/295,689. Although the conflicting claims are not 
identical, they are not patentably distinct from each other because they are substantially 
similar in scope claiming a method for matching graphic chains including graphic 
elements to phonetic chains including phonetic elements. 

This is a provisional obviousness-type double patenting rejection because the 
conflicting claims have not in fact been patented. 



Instant application 


Application 11/295,689 


Claims 1 and 7. A method and 


Claims 1, 5, and 6. A method, computer 


computer program, respectively. 


system, and computer program, respectively 


implemented in a computer for 


for causing a computer to construct an 


automatically matching graphic 


automaton for compiling grapheme/phoneme 


elements constituting given graphic 


transcription rules from an initial transcription 


chains automatically to phonetic 


corpus including pairs of chains, each pair 


elements constituting corresponding 


having a graphic chain including graphic 


phonetic chains, said method including 


elements and a phonetic chain including 


the following steps: 


phonetic elements. 
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entering global transcriptions of said 




graphic chains into said phonetic chains 




into a database accessible by said 




computer 




(Claims 1 and 7.) 


(Claims 1,5, and 6.) 


establishing and storing a link 


said method including the following steps 


between last elements of the graphic 


that are performed after grapheme/phoneme 


chain and phonetic chains of each 


correspondences have been registered in a 


second transcription and last elements 


database by aligning said graphic elements 


of the graphic chain and phonetic chains 


of the graphic chains with said phonetic 


of the transcription relating to said 


elements of the phonetic chains associated 


highest of said three respective second 


with said graphic chains: the method 


probabilities in order for links 


including the steps of: 


established in an MxN matrix relative to 




said second probabilities to constitute a 




single path between last and first pairs 




of graphic and phonetic elements of said 




matrix in order to segment said given 




graphic chain into graphemes 




corresponding to respective phonemes 




segmenting the corresponding phonetic 




chain and to store the matches between 
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said graphemes and plionemes in said 




database, the number of graphic 




elements in a grapheme being identical 




to the number of phonetic elements in 




the corresponding phoneme, in order for 




ally 1 lew yicipiiiu uiidiii lU Uc iidiiouiiucu 




automatically into a phonetic chain 




segmented into phonemes by means of 




the stored matches. 
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(Claims 1 and 7.) 


(Claims 1, 5, and 6.) 


for each transcription of a given 


deriving and storing transcription rules in 


graphic chain with M graphic elements 


said database on the basis of an analysis of 


into a corresponding phonetic chain with 


left-hand and right-hand correspondences of 


N phonetic elements, determining by 


each grapheme/phoneme correspondence in 


MxN iterations second probabilities of 


each pair of associated graphic and phonetic 


MxN second transcriptions of M graphic 


chains, and 


chains resulting from M successive 


causing said automaton to include states 


concatenations of 1 to M graphic 


and state transitions derived from the 


elements into N phonetic chains 


registered transcription rules, each state 


resulting from N successive 


being a link between two consecutive 


concatenations of 1 to N phonetic 


grapheme/phoneme correspondences in a 


elements, each second probability of a 


pair of graphic and phonetic chains and each 


second transcription depending on a 


transition chaining two states having a 


preceding estimated first probability of 


correspondence in common. 


last graphic and phonetic element of 




said second transcription and depending 




on the highest of three respective 




second probabilities determined by 




preceding iterations, M and N being 




integers, and 




establishing and storing a link 
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between last elennents of the graphic 




chain and phonetic chains of each 




second transcription and last elements 




of the graphic chain and phonetic chains 




of the transcription relating to said 




highest of said three respective second 




probabilities in order for links 




established in an MxN matrix relative to 




said second probabilities to constitute a 




single path between last and first pairs 




of graphic and phonetic elements of said 




matrix in order to segment said given 




graphic chain into graphemes 




corresponding to respective phonemes 




segmenting the corresponding phonetic 




chain and to store the matches between 




said graphemes and phonemes in said 




database, the number of graphic 




elements in a grapheme being identical 




to the number of phonetic elements in 




the corresponding phoneme, in order for 




any new graphic chain to be transcribed 
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automatically into a phonetic chain 
segmented into phonemes by means of 
the stored matches. 
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Claims 1 and 7. A metliod and 
computer program, respectively, 
implemented in a computer for 
automatically matching graphic 
elements constituting given graphic 
chains automatically to phonetic 
elements constituting corresponding 
phonetic chains, said method including 
the following steps: 


Claims 7, 11 , and 12. A method, computer 
system, and computer program, respectively, 
of causing a computer to construct a 
phoneticizer from a corpus stored in a 
database and including pairs of chains, each 
pair having a graphic chain including graphic 
elements and a phonetic chain including 
phonetic elements, said method including the 
steps of: 


(Claims 1 and 7.) 

for each transcription of a given 
graphic chain with M graphic elements 
into a corresponding phonetic chain with 
N phonetic elements, determining by 
MxN iterations second probabilities of 
MxN second transcriptions of M graphic 
chains resulting from M successive 
concatenations of 1 to M graphic 
elements into N phonetic chains 
resulting from N successive 


(Claims 7, 11, and 12.) 

constructing and storing in said database 

an automaton for compiling transcription 
rules resulting from an analysis of 
grapheme/phoneme correspondences in 
pairs of chains read in said corpus, said 
automaton including states and state 
transitions derived from transcription rules, 
each state being a link between two 
consecutive grapheme/phoneme 
correspondences in a pair of graphic and 
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concatenations of 1 to N plionetic 


phonetic chains, and each transition chaining 


elements, each second probability of a 


two states having a grapheme/phoneme 


second transcription depending on a 


correspondence in common, said transitions 


preceding estimated first probability of 


relating to the transcription of a graphic chain 


last graphic and phonetic element of 


into a phonetic chain forming a path of 


said second transcription and depending 


transitions in said automaton, and 


on the highest of three respective 


determining and storing in said database 


second probabilities determined by 


probabilities of the transitions at the output of 


preceding iterations, M and N being 


nodes of the automaton situating the 


integers, and 


grapheme/phoneme correspondences 


establishing and storing a link 


common to said transitions, in order to 


between last elements of the graphic 


construct said phoneticizer by combining 


chain and phonetic chains of each 


said automaton and the determined 


second transcription and last elements 


transition probabilities. 


of the graphic chain and phonetic chains 




of the transcription relating to said 




highest of said three respective second 




probabilities in order for links 




established in an MxN matrix relative to 




said second probabilities to constitute a 




single path between last and first pairs 




of graphic and phonetic elements of said 





Application/Control Number: 10/596,425 
Art Unit: 2626 


Page 1 3 


matrix in order to segment said given 




grapliic cliain into grapliemes 




corresponding to respective phonemes 




segmenting the corresponding phonetic 




chain and to store the matches between 




said graphemes and phonemes in said 




database, the number of graphic 




elements in a grapheme being identical 




to the number of phonetic elements in 




the corresponding phoneme, in order for 




any new graphic chain to be transcribed 




automatically into a phonetic chain 




segmented into phonemes by means of 




the stored matches. 





More specifically, as for the limitation "an automaton for compiling 
grapheme/phoneme transcription rules from an initial transcription corpus including 
pairs of chains, each pair having a graphic chain including graphic elements and a 
phonetic chain including phonetic elements" as provided in claims 1 , 5, and 6 from 
application 11 7295,689, it would have been obvious to a person having ordinary skill in 
the art at the time of the invention that in claims 1 and 7 from the instant application the 
limitations "automatically matching graphic elements constituting given graphic chains 
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automatically to phonetic elements constituting corresponding phonetic chains" and 
"entering global transcriptions of said graphic chains into said phonetic chains into a 
database accessible by said computer" are not significantly distinct from application 
1 1/295,689 given that the "compiling grapheme/phoneme transcription rules from an 
initial transcription corpus" and using "global transcriptions of said graphic chains into 
said phonetic chains" are similar steps to obtain a same result. 

As for the limitation "said method including the following steps that are performed 
after grapheme/phoneme correspondences have been registered in a database by 
aligning said graphic elements of the graphic chains with said phonetic elements of the 
phonetic chains associated with said graphic chains" as provided in claims 1 , 5, and 6 
from application 1 1/295,689, it would have been obvious to a person having ordinary 
skill in the art at the time of the invention that in claims 1 and 7 from the instant 
application the limitations "establishing and storing a link between last elements of the 
graphic chain and phonetic chains of each second transcription and last elements of the 
graphic chain and phonetic chains of the transcription" and "in order to segment said 
given graphic chain into graphemes corresponding to respective phonemes segmenting 
the corresponding phonetic chain and to store the matches between said graphemes 
and phonemes in said database, the number of graphic elements in a grapheme being 
identical to the number of phonetic elements in the corresponding phoneme, in order for 
any new graphic chain to be transcribed automatically into a phonetic chain segmented 
into phonemes by means of the stored matches" are not significantly distinct from 
application 1 1/295,689 given that the instant application stores the link that represent 
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the chains in order for new graphic chains to be transcribed automatically just like 
application 1 1/295,689 performs grapheme/phoneme correspondences with the stored 
chains in the database. 

As for the limitation "deriving and storing transcription rules in said database on 
the basis of an analysis of left-hand and right-hand correspondences of each 
grapheme/phoneme correspondence in each pair of associated graphic and phonetic 
chains, and causing said automaton to include states and state transitions derived from 
the registered transcription rules, each state being a link between two consecutive 
grapheme/phoneme correspondences in a pair of graphic and phonetic chains and each 
transition chaining two states having a correspondence in common" as provided in 
claims 1, 5, and 6 from application 1 1/295,689, it would have been obvious to a person 
having ordinary skill in the art at the time of the invention that in claims 1 and 7 from the 
instant application the limitations "for each transcription of a given graphic chain with M 
graphic elements into a corresponding phonetic chain with N phonetic elements, 
determining by MxN iterations second probabilities of MxN second transcriptions of M 
graphic chains resulting from M successive concatenations of 1 to M graphic elements 
into N phonetic chains resulting from N successive concatenations of 1 to N phonetic 
elements" and "establishing and storing a link between last elements of the graphic 
chain and phonetic chains of each second transcription and last elements of the graphic 
chain and phonetic chains of the transcription relating to said highest of said three 
respective second probabilities in order for links established in an MxN matrix relative to 
said second probabilities to constitute a single path between last and first pairs of 
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graphic and phonetic elements of said matrix in order to segment said given graphic 
chain into graphemes corresponding to respective phonemes segmenting the 
corresponding phonetic chain and to store the matches between said graphemes and 
phonemes in said database," are not substantially different from application 1 1/295,689 
given that the analysis of the left-hand and right-hand correspondences of each 
grapheme-phoneme correspondence (application 1 1/295,689) is the same as the 
established link between the last and first pairs of graphic and phonetic elements 
(instant application), also the states and state transitions derived from the registered 
transcription rules with a link between the grapheme/phoneme correspondences 
chaining the two states (application 1 1/298,689) is the same as the last pair of graphic 
and phonetic elements being linked with the fist pairs of graphic and phonetic elements 
(instant application). 

As per claims 7, 1 1 , and 12 from application 1 1/295,689, the obviousness 
analysis provided above for claims 1 , 5, and 6, apply as well. Additionally, it would have 
been obvious to a person having ordinary skill in the art at the time of the invention that 
"a phoneticizer" as claimed by application 1 1/295,689 is a general term for the system 
or computer program performing the steps provided by the instant application's method 
of "automatically matching graphic elements constituting given graphic chains to 
phonetic elements constituting corresponding phonetic chains" as claimed in claims 1 
and 7. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl^ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-4 and 6-7 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Luk et al. (Stochastic phonographic transduction for English, 1996) (hereinafter 
Luk) In view of Grinlasty US 20030088416 Al (hereinafter Grinlasty). 

As per claims 1 and 7, Luk teaches a method and computer program 
implemented in a computer for automatically matching graphic elements constituting 
given graphic chains automatically to phonetic elements constituting corresponding 
phonetic chains, said method including the following steps: 

entering global transcriptions of said graphic chains into said phonetic chains into 
a database accessible by said computer (Abstract, lines 5-10. Also, in Section 4. 
Inferring correspondences and rule probabilities, page 140, last paragraph, lines 1-10), 

estimating and storing In said database first probabilities of elementary 
transcriptions of graphic elements into respective phonetic elements (Section 4.1 .1 . 
Pass 1, on page 141, more specifically, last paragraph of section 4.1.1 on page 142. 
Also, in Section 4. Inferring correspondences and rule probabilities, page 140, last 
paragraph, lines 1-10), 
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for each transcription of a given graphic chain with IVI graphic elements into a 
corresponding phonetic chain with N phonetic elements, determining by MxN iterations 
second probabilities of MxN second transcriptions of M graphic chains resulting from M 
successive concatenations of 1 to M graphic elements into N phonetic chains resulting 
from N successive concatenations of 1 to N phonetic elements, each second probability 
of a second transcription depending on a preceding estimated first probability of last 
graphic and phonetic element of said second transcription and depending on the 
highest of three respective second probabilities determined by preceding iterations, M 
and N being integers (Section 4.1 .2. Pass 2, on page 142, more specifically equation for 
p(i,j) and Fig. 3), and 

establishing and storing a link between last elements of the graphic chain and 
phonetic chains of each second transcription and last elements of the graphic chain and 
phonetic chains of the transcription relating to said highest of said three respective 
second probabilities in order for links established in an MxN matrix relative to said 
second probabilities to constitute a single path between last and first pairs of graphic 
and phonetic elements of said matrix in order to segment said given graphic chain into 
graphemes corresponding to respective phonemes segmenting the corresponding 
phonetic chain and to store the matches between said graphemes and phonemes in 
said database, the number of graphic elements in a grapheme being identical to the 
number of phonetic elements in the corresponding phoneme, in order for any new 
graphic chain to be transcribed automatically into a phonetic chain segmented into 
phonemes by means of the stored matches (Section 4.1 .2. Pass 2, on page 142, more 
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specifically lines 1-12 and Fig. 3, and Abstract, lines 19-20. Also, in Section 4. Inferring 
correspondences and rule probabilities, page 140, last paragraph, lines 1-10). 

However, Luk fails to teach determining by MxN iterations second probabilities of 
MxN second transcriptions of M graphic chains resulting from M successive 
concatenations of 1 to M graphic elements into N phonetic chains resulting from N 
successive concatenations of 1 to N phonetic elements 

the highest of said three respective second probabilities in order for links 
established in an MxN matrix relative to said second probabilities to constitute a single 
path between last and first pairs of graphic and phonetic elements of said matrix in 
order to segment said given graphic chain into graphemes corresponding to respective 
phonemes segmenting the corresponding phonetic chain and to store the matches 
between said graphemes and phonemes in said database 

Griniasty teaches that in some speech recognition systems, hidden Markov 
models (HMMs) of words are obtained by a concatenation of phoneme HMM's. To build 
word models in such systems, one needs to know the phoneme string that corresponds 
to the word. In many cases, the phoneme string for a word (i.e., the pronunciation) can 
be found in a phonetic dictionary. However, many valid words (e.g., family names, 
business names, etc.) are not typically included within a phonetic dictionary. Therefore, 
there is a general need for a text-to-phoneme parser that can automatically generate a 
phoneme string for a written word (Griniasty [0002]). 

Griniasty improves this concept by teaching to implement the generalized HMM 
process 100 of FIG. 6, a "generalized" emission probability matrix and a "generalized" 
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transition probability matrix may be defined. The generalized emission probability 
matrix may include, for example, probabilities that specific letter strings will be induced 
given a phoneme and a previous phoneme (i.e., P(letter string.vertline. phoneme, 
previous phoneme)). The generalized transition probability matrix may include, for 
example, probabilities that specific phonemes will occur given a previous phoneme and 
a previous letter string (i.e., P(phoneme.vertline.previous phoneme, previous letter 
string)). In at least one embodiment of the present invention, the training method 
illustrated in FIGS. 3 and 4 is modified to generate the generalized emission probability 
matrix and generalized transition probability matrix described above. For example, in 
block 54 of FIG. 4, instead of generating a phoneme emission probability matrix and a 
phoneme transition probability matrix, the generalized emission probability matrix and 
generalized transition probability matrix may be generated using the results of the most 
recent supervised segmentation. Additional cycles of segmentation and matrix 
regeneration may then be performed to further refine the generalized emission 
probability matrix and generalized transition probability matrix. Final matrices are 
eventually generated and stored for later use during text-to-phoneme parsing operations 
(Griniasty [0029]). 

Further, Griniasty teaches With reference to FIG. 5, within square 68, the 
probability that the phoneme "L" will emit the letter "L" is entered (indicated in the figure 
as L.vertline.L, where the second L is the phoneme). In square 70, the probability that 
the phoneme pair "L, OW" will emit the letter "L" (i.e., a diphone) is entered. In square 
72, the probability that phoneme "L" will emit the letter string "LO" is entered. In square 
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74, the sum of: (a) the probability that phoneme "L" will emit the letter "L" and (b) the 
probability that phoneme "OW" will emit the letter "O" is entered. As is apparent, a path 
has been created from square 68 to square 74 and the sum represents the score of the 
path to this square. Two paths lead to square 76 in table 66. In one search approach, 
scores are calculated for each of these paths and the higher of the two scores is then 
recorded for the square along with the corresponding path information. The first path 
that leads to square 76 comes from square 68 and involves the emission of the letter 
"O" by the phoneme pair "OW, K." The score for this path is the sum of: (a) the 
probability that phoneme "L" will emit the letter "L" (from square 68) and (b) the 
probability that the phoneme pair "OW, K" will emit the letter "O." The second path that 
leads to square 76 comes from square 70 and involves the emission of the letter "O" by 
the phoneme "K." The score for this path is the sum of: (a) the probability that the 
phoneme pair "L,OW" will emit the letter "L" (from square 70) and (b) the probability that 
phoneme "K" will emit the letter "O." After scores have been calculated for the two 
paths, the higher score is recorded along with the corresponding path information 
(Griniasty [0016]). 

Furthermore, Griniasty teaches the probability that the phoneme "L" will emit the 
letter string "LOG" is entered as the score. Like square 76, two paths lead square 80. 
The first path, from square 68, has a score that is the sum of: (a) the probability that 
phoneme "L" will emit the letter "L" (from square 68) and (b) the probability that 
phoneme "OW" will emit the letter string "OC." The second path, from square 72, has a 
score that is the sum of: (a) the probability that phoneme "L" will emit the letter string 
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"LO" (from square 72) and (b) the probability that phoneme "OW" will emit the letter "C." 
Again, the higher score is recorded along with the corresponding path information. 
Three paths lead to square 82. The first path, from square 74, has a score that is the 
sum of the score of square 74 and the probability that phoneme "K" will emit the letter 
"C." The second path, from square 70, has a score that is the sum of the score of 
square 70 and the probability that phoneme "K" will emit the letter string "OC." The third 
path, from square 72, has a score that is the sum of the score of square 72 and the 
probability that phoneme pair "OW, K" will emit the letter "C." The highest of the three 
scores is then recorded along with corresponding path information (Griniasty [0017]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Luk to incorporate determining by MxN 
iterations second probabilities of MxN second transcriptions of M graphic chains 
resulting from M successive concatenations of 1 to M graphic elements into N phonetic 
chains resulting from N successive concatenations of 1 to N phonetic elements and the 
highest of said three respective second probabilities in order for links established in an 
MxN matrix relative to said second probabilities to constitute a single path between last 
and first pairs of graphic and phonetic elements of said matrix in order to segment said 
given graphic chain into graphemes corresponding to respective phonemes segmenting 
the corresponding phonetic chain and to store the matches between said graphemes 
and phonemes in said database as taught by Griniasty to allow for a final ranked set of 
phonemes based on previous phonemes, wherein the optimum score based on 
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probability is generated in order to find the best patli to concatenate plionennes in tiie 
form of a matrix to display all possible probabilities (Griniasty [0016]-[0017]). 

As per claim 2, Luk teaches a method according to claim 1, wherein said 
respective first probability for the determination of a second probability relating to a 
second transcription of a graphic chain concatenating m graphic elements into a 
phonetic chain concatenating n phonetic elements, with 1 < m < M and 1 < n < N, 
relates to the last elements in the graphic chain with m graphic elements and the 
phonetic chain with n phonetic elements (Section 4.1 .2. Pass 2, on page 142, more 
specifically equation lor p(i,j), and Abstract, lines 19-20.). 

However, Luk fails to teach concatenating n phonetic elements, with 1 < m < M 
and 1 < n < N 

Griniasty teaches that in some speech recognition systems, hidden Markov 
models (HMMs) of words are obtained by a concatenation of phoneme HMM's. To build 
word models in such systems, one needs to know the phoneme string that corresponds 
to the word. In many cases, the phoneme string for a word (i.e., the pronunciation) can 
be found in a phonetic dictionary. However, many valid words (e.g., family names, 
business names, etc.) are not typically included within a phonetic dictionary. Therefore, 
there is a general need for a text-to-phoneme parser that can automatically generate a 
phoneme string for a written word (Griniasty [0002]). 

Griniasty improves this concept by teaching to implement the generalized HMM 
process 100 of FIG. 6, a "generalized" emission probability matrix and a "generalized" 



Application/Control Number: 10/596,425 Page 24 

Art Unit: 2626 

transition probability matrix may be defined. The generalized emission probability 
matrix may include, for example, probabilities that specific letter strings will be induced 
given a phoneme and a previous phoneme (i.e., P(letter string.vertline. phoneme, 
previous phoneme)). The generalized transition probability matrix may include, for 
example, probabilities that specific phonemes will occur given a previous phoneme and 
a previous letter string (i.e., P(phoneme.vertline.previous phoneme, previous letter 
string)). In at least one embodiment of the present invention, the training method 
illustrated in FIGS. 3 and 4 is modified to generate the generalized emission probability 
matrix and generalized transition probability matrix described above. For example, in 
block 54 of FIG. 4, instead of generating a phoneme emission probability matrix and a 
phoneme transition probability matrix, the generalized emission probability matrix and 
generalized transition probability matrix may be generated using the results of the most 
recent supervised segmentation. Additional cycles of segmentation and matrix 
regeneration may then be performed to further refine the generalized emission 
probability matrix and generalized transition probability matrix. Final matrices are 
eventually generated and stored for later use during text-to-phoneme parsing operations 
(Griniasty [0029]). 

Further, Griniasty teaches With reference to FIG. 5, within square 68, the 
probability that the phoneme "L" will emit the letter "L" is entered (indicated in the figure 
as L.vertline.L, where the second L is the phoneme). In square 70, the probability that 
the phoneme pair "L, OW" will emit the letter "L" (i.e., a diphone) is entered. In square 
72, the probability that phoneme "L" will emit the letter string "LO" is entered. In square 
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74, the sum of: (a) the probability that phoneme "L" will emit the letter "L" and (b) the 
probability that phoneme "OW" will emit the letter "O" is entered. As is apparent, a path 
has been created from square 68 to square 74 and the sum represents the score of the 
path to this square. Two paths lead to square 76 in table 66. In one search approach, 
scores are calculated for each of these paths and the higher of the two scores is then 
recorded for the square along with the corresponding path information. The first path 
that leads to square 76 comes from square 68 and involves the emission of the letter 
"O" by the phoneme pair "OW, K." The score for this path is the sum of: (a) the 
probability that phoneme "L" will emit the letter "L" (from square 68) and (b) the 
probability that the phoneme pair "OW, K" will emit the letter "O." The second path that 
leads to square 76 comes from square 70 and involves the emission of the letter "O" by 
the phoneme "K." The score for this path is the sum of: (a) the probability that the 
phoneme pair "L,OW" will emit the letter "L" (from square 70) and (b) the probability that 
phoneme "K" will emit the letter "O." After scores have been calculated for the two 
paths, the higher score is recorded along with the corresponding path information 
(Griniasty [0016]). 

Furthermore, Griniasty teaches the probability that the phoneme "L" will emit the 
letter string "LOG" is entered as the score. Like square 76, two paths lead square 80. 
The first path, from square 68, has a score that is the sum of: (a) the probability that 
phoneme "L" will emit the letter "L" (from square 68) and (b) the probability that 
phoneme "OW" will emit the letter string "OC." The second path, from square 72, has a 
score that is the sum of: (a) the probability that phoneme "L" will emit the letter string 
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"LO" (from square 72) and (b) the probability that phoneme "OW" will emit the letter "C." 
Again, the higher score is recorded along with the corresponding path information. 
Three paths lead to square 82. The first path, from square 74, has a score that is the 
sum of the score of square 74 and the probability that phoneme "K" will emit the letter 
"C." The second path, from square 70, has a score that is the sum of the score of 
square 70 and the probability that phoneme "K" will emit the letter string "OC." The third 
path, from square 72, has a score that is the sum of the score of square 72 and the 
probability that phoneme pair "OW, K" will emit the letter "C." The highest of the three 
scores is then recorded along with corresponding path information (Griniasty [0017]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Luk to incorporate concatenating n 
phonetic elements, with 1 < m < M and 1 < n < N as taught by Griniasty to allow for a 
final ranked set of phonemes based on previous phonemes, wherein the optimum score 
based on probability is generated in order to find the best path to concatenate 
phonemes in the form of a matrix to display all possible probabilities (Griniasty [0016]- 
[0017]). 

As per claim 3, Luk teaches a method according to claim 1, wherein said three 
respective second probabilities determined beforehand for said second transcription of 
the graphic chain with m graphic elements into the phonetic chain with n phonetic 
elements respectively relate to a second transcription of a graphic chain with m-1 
graphic elements into the phonetic chain with n phonetic elements, a second 
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transcription of the graphic chain with m graphic elements into a phonetic chain with n-1 
phonetic elements and a second transcription of the graphic chain with m-1 graphic 
elements Into the phonetic chain with n-1 phonetic elements (Section 4.1 .2. Pass 2, on 
page 142, more specifically equation ^or p(i,j) ). 

However, Luk fails to teach graphic chain with m-1 graphic elements Into the 
phonetic chain with n-1 phonetic elements 

chain with m graphic elements Into the phonetic chain with n phonetic elements 
respectively relate to a second transcription of a graphic chain with m-1 graphic 
elements into the phonetic chain with n phonetic elements 

Griniasty teaches that In some speech recognition systems, hidden Markov 
models (HMMs) of words are obtained by a concatenation of phoneme HMM's. To build 
word models In such systems, one needs to know the phoneme string that corresponds 
to the word. In many cases, the phoneme string for a word (i.e., the pronunciation) can 
be found in a phonetic dictionary. However, many valid words (e.g., family names, 
business names, etc.) are not typically Included within a phonetic dictionary. Therefore, 
there Is a general need for a text-to-phoneme parser that can automatically generate a 
phoneme string for a written word (Griniasty [0002]). 

Griniasty improves this concept by teaching to implement the generalized HMM 
process 100 of FIG. 6, a "generalized" emission probability matrix and a "generalized" 
transition probability matrix may be defined. The generalized emission probability 
matrix may Include, for example, probabilities that specific letter strings will be Induced 
given a phoneme and a previous phoneme (I.e., P(letter strlng.vertllne. phoneme. 
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previous plioneme)). The generalized transition probability matrix may include, for 
example, probabilities that specific phonemes will occur given a previous phoneme and 
a previous letter string (i.e., P(phoneme.vertline.previous phoneme, previous letter 
string)). In at least one embodiment of the present invention, the training method 
illustrated in FIGS. 3 and 4 is modified to generate the generalized emission probability 
matrix and generalized transition probability matrix described above. For example, in 
block 54 of FIG. 4, instead of generating a phoneme emission probability matrix and a 
phoneme transition probability matrix, the generalized emission probability matrix and 
generalized transition probability matrix may be generated using the results of the most 
recent supervised segmentation. Additional cycles of segmentation and matrix 
regeneration may then be performed to further refine the generalized emission 
probability matrix and generalized transition probability matrix. Final matrices are 
eventually generated and stored for later use during text-to-phoneme parsing operations 
(Griniasty [0029]). 

Further, Griniasty teaches With reference to FIG. 5, within square 68, the 
probability that the phoneme "L" will emit the letter "L" is entered (indicated in the figure 
as L.vertline.L, where the second L is the phoneme). In square 70, the probability that 
the phoneme pair "L, OW" will emit the letter "L" (i.e., a diphone) is entered. In square 
72, the probability that phoneme "L" will emit the letter string "LO" is entered. In square 
74, the sum of: (a) the probability that phoneme "L" will emit the letter "L" and (b) the 
probability that phoneme "OW" will emit the letter "O" is entered. As is apparent, a path 
has been created from square 68 to square 74 and the sum represents the score of the 
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path to this square. Two paths lead to square 76 in table 66. In one search approach, 
scores are calculated for each of these paths and the higher of the two scores is then 
recorded for the square along with the corresponding path information. The first path 
that leads to square 76 comes from square 68 and involves the emission of the letter 
"O" by the phoneme pair "OW, K." The score for this path is the sum of: (a) the 
probability that phoneme "L" will emit the letter "L" (from square 68) and (b) the 
probability that the phoneme pair "OW, K" will emit the letter "O." The second path that 
leads to square 76 comes from square 70 and involves the emission of the letter "O" by 
the phoneme "K." The score for this path is the sum of: (a) the probability that the 
phoneme pair "L,OW" will emit the letter "L" (from square 70) and (b) the probability that 
phoneme "K" will emit the letter "O." After scores have been calculated for the two 
paths, the higher score is recorded along with the corresponding path information 
(Griniasty [0016]). 

Furthermore, Griniasty teaches the probability that the phoneme "L" will emit the 
letter string "LOG" is entered as the score. Like square 76, two paths lead square 80. 
The first path, from square 68, has a score that is the sum of: (a) the probability that 
phoneme "L" will emit the letter "L" (from square 68) and (b) the probability that 
phoneme "OW" will emit the letter string "OC." The second path, from square 72, has a 
score that is the sum of: (a) the probability that phoneme "L" will emit the letter string 
"LO" (from square 72) and (b) the probability that phoneme "OW" will emit the letter "G." 
Again, the higher score is recorded along with the corresponding path information. 
Three paths lead to square 82. The first path, from square 74, has a score that is the 
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sum of the score of square 74 and the probability that phoneme "K" will emit the letter 
"C." The second path, from square 70, has a score that is the sum of the score of 
square 70 and the probability that phoneme "K" will emit the letter string "OC." The third 
path, from square 72, has a score that is the sum of the score of square 72 and the 
probability that phoneme pair "OW, K" will emit the letter "C." The highest of the three 
scores is then recorded along with corresponding path information (Griniasty [0017]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Luk to incorporate graphic chain with m-1 
graphic elements into the phonetic chain with n-1 phonetic elements and chain with m 
graphic elements into the phonetic chain with n phonetic elements respectively relate to 
a second transcription of a graphic chain with m-1 graphic elements into the phonetic 
chain with n phonetic elements as taught by Griniasty to allow for a final ranked set of 
phonemes based on previous phonemes, wherein the optimum score based on 
probability is generated in order to find the best path to concatenate phonemes in the 
form of a matrix to display all possible probabilities (Griniasty [0016]-[0017]). 

As per claim 4, Luk teaches a method according to claim 1, comprising 
estimating other first probabilities of transcriptions of each of said graphic elements 
respectively into said phonetic elements as a function of the ranks of said phonetic 
elements placed in said given phonetic chains that were segmented into phonemes, in 
order again to determine second probabilities of MxN second transcriptions of each 
transcription of a given graphic chain with M graphic elements into a corresponding 
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phonetic chain with N phonetic elements and to establish a corrected path linking the 
last pair to the first pair in a new MxN matrix of second probabilities (Section 4.1 .3. Pass 
3, and Section 4.2. Re-estimation of transition probabilities, more specifically, lines 1-6). 

However, Luk fails to teach second probabilities of MxN second transcriptions of 
each transcription of a given graphic chain with M graphic elements into a 
corresponding phonetic chain with N phonetic elements and to establish a corrected 
path linking the last pair to the first pair in a new MxN matrix of second probabilities. 

Griniasty teaches that in some speech recognition systems, hidden Markov 
models (HMMs) of words are obtained by a concatenation of phoneme HMM's. To build 
word models in such systems, one needs to know the phoneme string that corresponds 
to the word. In many cases, the phoneme string for a word (i.e., the pronunciation) can 
be found in a phonetic dictionary. However, many valid words (e.g., family names, 
business names, etc.) are not typically included within a phonetic dictionary. Therefore, 
there is a general need for a text-to-phoneme parser that can automatically generate a 
phoneme string for a written word (Griniasty [0002]). 

Griniasty improves this concept by teaching to implement the generalized HMM 
process ICQ of FIG. 6, a "generalized" emission probability matrix and a "generalized" 
transition probability matrix may be defined. The generalized emission probability 
matrix may include, for example, probabilities that specific letter strings will be induced 
given a phoneme and a previous phoneme (i.e., P(letter string.vertline. phoneme, 
previous phoneme)). The generalized transition probability matrix may include, for 
example, probabilities that specific phonemes will occur given a previous phoneme and 
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a previous letter string (i.e., P(phoneme.vertline.previous phoneme, previous letter 
string)). In at least one embodiment of the present invention, the training method 
illustrated in FIGS. 3 and 4 is modified to generate the generalized emission probability 
matrix and generalized transition probability matrix described above. For example, in 
block 54 of FIG. 4, instead of generating a phoneme emission probability matrix and a 
phoneme transition probability matrix, the generalized emission probability matrix and 
generalized transition probability matrix may be generated using the results of the most 
recent supervised segmentation. Additional cycles of segmentation and matrix 
regeneration may then be performed to further refine the generalized emission 
probability matrix and generalized transition probability matrix. Final matrices are 
eventually generated and stored for later use during text-to-phoneme parsing operations 
(Griniasty [0029]). 

Further, Griniasty teaches With reference to FIG. 5, within square 68, the 
probability that the phoneme "L" will emit the letter "L" Is entered (Indicated In the figure 
as L.vertline.L, where the second L is the phoneme). In square 70, the probability that 
the phoneme pair "L, OW" will emit the letter "L" (i.e., a diphone) is entered. In square 
72, the probability that phoneme "L" will emit the letter string "LO" Is entered. In square 
74, the sum of: (a) the probability that phoneme "L" will emit the letter "L" and (b) the 
probability that phoneme "OW" will emit the letter "O" is entered. As is apparent, a path 
has been created from square 68 to square 74 and the sum represents the score of the 
path to this square. Two paths lead to square 76 in table 66. In one search approach, 
scores are calculated for each of these paths and the higher of the two scores is then 
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recorded for the square along with the corresponding path information. The first path 
that leads to square 76 comes from square 68 and involves the emission of the letter 
"O" by the phoneme pair "OW, K." The score for this path is the sum of: (a) the 
probability that phoneme "L" will emit the letter "L" (from square 68) and (b) the 
probability that the phoneme pair "OW, K" will emit the letter "O." The second path that 
leads to square 76 comes from square 70 and involves the emission of the letter "O" by 
the phoneme "K." The score for this path is the sum of: (a) the probability that the 
phoneme pair "L,OW" will emit the letter "L" (from square 70) and (b) the probability that 
phoneme "K" will emit the letter "O." After scores have been calculated for the two 
paths, the higher score is recorded along with the corresponding path information 
(Griniasty [0016]). 

Furthermore, Griniasty teaches the probability that the phoneme "L" will emit the 
letter string "LOG" is entered as the score. Like square 76, two paths lead square 80. 
The first path, from square 68, has a score that is the sum of: (a) the probability that 
phoneme "L" will emit the letter "L" (from square 68) and (b) the probability that 
phoneme "OW" will emit the letter string "OC." The second path, from square 72, has a 
score that is the sum of: (a) the probability that phoneme "L" will emit the letter string 
"LO" (from square 72) and (b) the probability that phoneme "OW" will emit the letter "C." 
Again, the higher score is recorded along with the corresponding path information. 
Three paths lead to square 82. The first path, from square 74, has a score that is the 
sum of the score of square 74 and the probability that phoneme "K" will emit the letter 
"C." The second path, from square 70, has a score that is the sum of the score of 
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square 70 and the probability that phoneme "K" will emit the letter string "OC." The third 
path, from square 72, has a score that is the sum of the score of square 72 and the 
probability that phoneme pair "OW, K" will emit the letter "C." The highest of the three 
scores is then recorded along with corresponding path information (Griniasty [0017]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Luk to incorporate second probabilities of 
MxN second transcriptions of each transcription of a given graphic chain with M graphic 
elements into a corresponding phonetic chain with N phonetic elements and to establish 
a corrected path linking the last pair to the first pair in a new MxN matrix of second 
probabilities as taught by Griniasty to allow for a final ranked set of phonemes based on 
previous phonemes, wherein the optimum score based on probability is generated in 
order to find the best path to concatenate phonemes in the form of a matrix to display all 
possible probabilities (Griniasty [0016]-[0017]). 

As per claim 6, Luk teaches a method according to claim 1 , wherein said 
phonetic chains are phonetically readable by any person who is not an expert in 
phonetics, and said new graphic chain is automatically transcribed into a phonetic chain 
segmented into phonemes that can be read by any person who is not an expert in 
phonetics by means of stored matches to be included in a short message (Section 2. 
Principles of stochastic phonographic transduction, second paragraph, lines 9-10). 
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6. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Luk 
(Stochastic phonographic transduction for English, 1998) in view of Griniasty US 
20030088416 A1 (hereinafter Griniasty) and further in view of Junqua et al. (US 
Patent 6,684,185) (hereinafter Junqua). 

As per claim 5, Luk teaches a method according to claim 1, wherein said new 
graphic chain is being entered and said phonetic chain segmented into phonemes by 
means of said stored matches is used for orthographic correction of said new graphic 
chain entered (Section 4. Inferring correspondences and rule probabilities, page 140, 
last paragraph, lines 1-10, and Section 6.2. Training and test data, first paragraph, lines 
4-6, also Abstract starting in page 133, third paragraph lines 1-3 and 7-9. It is noted 
that Luk does not specifically mention the intended use of the system for orthographic 
correction of said new graphic chain entered, however, it would have been obvious to a 
person having ordinary skill in the art at the time of the invention that since Luk's 
method provides all of the limitations as set forth in claims 1 and 5 for performing 
transcriptions of graphic chains to phonetic chains, the method is also capable or useful 
for providing the function of orthographic correction.). 

However, Luk in view of Griniasty does not specifically mention the new graphic 
chain being entered on a terminal keyboard. 

Conversely, Junqua teaches the new graphic chain being entered on a terminal 
keyboard (Col. 1 , line 62 to Col. 2, line 2). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to have used the feature of the new graphic chain being entered on 
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a terminal l<eyboard as tauglit by Junqua for Luk's metliod because Junqua provides a 
small memory footprint recognizer that may be trained quickly and without large 
memory consumption by entry of new words through spelling, wherein the entry could 
be through a keyboard or a touch-tone pad of a telephone (Col. 1 , lines 62-67). The 
spelled word entered by the user is processed by a phoneticizer which converts the 
spelled word letters into one or more phonetic transcriptions (Col. 4, lines 38-40). 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael C. Colucci whose telephone number is (571)- 
270-1847. The examiner can normally be reached on 9:30 am - 6:00 pm, Monday- 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571 )-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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